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1 Introduction 

The last decade transformed faceted navigation^ from a "nice-to- 
have" into a "must-have functionality" for all online web services 
that contain a search functionality. All commercial websites have 
undergone this change from online clothing stores to travel agencies, 
all driven by the wish of facilitating instant access to their products. 
From commerce it shifted to other domains, such as libraries, as well. 
Today, faceted browsing is one of the most common functionalities 
in library products, built to improve a search function and enhance 
already existing catalogs by preventing zero result hits and offering 
users the possibility to look for objects without knowing exactly 
what they are looking for. Commonly, the faceted navigation of 
today's library catalogs' include facets such as authors, subjects, 
formats, printers, publication year etc. Nevertheless, all other field 
related to existing metadata can be used as facets. As facets are sold 
to users as an advantage and improvement of an existing service, it 
is important to assure, that the user's perception goes along with 
or differs from these assumptions, hence the reason for this paper 

'Used equally for: faceted browsing, faceted search 
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in which we want to discuss the following questions concerning 
faceted navigation: 

1. What is the user's perception of faceted navigation in digital 
libraries? 

2. Which design issues play an important role for a user-friendly 
application of faceted navigation in the context of digital li¬ 
braries? 

The answers to these questions will be given in the context of the 
project ACCEPT, a subproject of a Swiss national initiative e-lib.ch^. 
The subproject was installed to analyze the usability and usefulness 
of digital libraries by using quantitative as well as qualitative meth¬ 
ods for user centered design. In this context, the faceted navigation 
has been subject of seven qualitative usability evaluation studies. In 
2009, a focus group with seven participants from the field of infor- 
mahon science has been conducted with the aim to discuss about 
interface design issues of the Meta catalog swissbib.ch^. Somme 
common usability tests with thinking aloud method and the use 
of a usability software have been directed between 2010 and 2011. 
One evaluated the manuscript website e-codices.ch^, by comparing 
it to another manuscript database called Penn in Hand^, another 
concentrated on the faceted navigation of swissbib.ch by comparing 
it with the correspondent functionality in SIRIS® and the last one 
evaluated the digital library website e-rara.ch^ by using eye tracking 

^Swiss Electronic Library, http://www.e-lib.ch/en 

^Swiss metacatalog of the Swiss University Libraries and the National Library, 
https://www.swissbib.ch/?lng=en. 

^Virtual Manuscript Library of Switzerland, http://www.e-codices.unifr.ch 

^Selected Manuscripts - University of Pennsylvania, http://dla.library.upenn. 
edu/dla/medren/index.html 

^Smithonian Institution, Research Information Systems, http://www.siris.si.edu 

^Swiss digitized rare books, http://www.e-rara.ch/?lang=en 
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technology. As a last source of data, three online usability tests have 
been analyzed more in detail. They have been conducted between 
2012 and 2013 using in all cases an online usability testing software. 
In 2012, the search tool RODIN® has been evaluated online. One 
year later, an online usability test has been conducted in order to 
evaluate swissbib.ch and last but not least, an online evaluation has 
been directed in order to evaluate the website of e-lib.ch. Based on 
fhese resulfs, fhe above-menfioned questions shall be answered. 


2 What is the user's perception of faceted 
navigation in digital libraries? 

Generally, fhe literafure shows fhaf fibers provided fhrough facefed 
navigation are considered fo be useful fo end users. Resulfs of sev¬ 
eral tests have shown that the participants' satisfaction is higher 
with a faceted system ((Uddin and Janecek; Zhang and Marchionini; 
Yee, Swearingen, Li, et al.;)) than with general search forms. Still, 
the initial reactions to the faceted interface may be cautious, as it 
might be seen as different or unfamiliar. This concerns in most of the 
cases users who are new to the concept of facefed navigafion. ((Yee, 
Swearingen, Li, et ah; Zhang and Marchionini;)) Another impor¬ 
tant result is the fact that faceted navigation has the effect of more 
successful searches ((Uddin and Janecek; Zhang and Marchionini; 
Teevan, Dumais, and Gutt;)). Yee and English stated that facets help 
avoiding dead ends, which features the original sense of faceted 
navigation ((Yee, Swearingen, Li, et al.; English, Hearst, Sinha, et al.; 
)). It has also been proved that users are faster with facets than with 
simple, well-known search interactions ((Uddin and Janecek) [cited 

*Roue d'information, http: / /campus.hesge.ch/id_bilingue/projekte/rodin/ 
indexjr.asp 
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inFAGAN2010]). 

The results of ACCEPT confirm fhese general findings. In five 
of seven sfudies, fhe general opinion abouf facefed browsing was 
posifive (2, 3,4, 5, and 7).® 

Firsf of all, parficipanfs menfion fhaf facefs accelerafe and facil- 
ifafe fhe search process (4). By sfarfing with a simple search and 
getting machine-generated possibilities for furfher filfering, fhe in- 
fellecfual implicafions are smaller fhan wifh advanced search forms 
and fhe overall research process becomes fasfer (3,4,5, 7). Furfher- 
more, in one study, a user discovered documents by using the facets 
that he wasn't aware of (2). Negafive poinfs were menfioned in two 
sfudies, whenever users were confronfed wifh facefs for fhe firsf 
fime (4 and 5). In bofh cases, uncerfainfy abouf fhe funcfionalify as 
a whole and abouf how fhe generafion of facefs works were sfafed. 


3 Which design issues seem to play an 
important role for a user-friendly 
application of faceted navigation in the 
context of digital libraries? 

On behalf of fhe purely performance orienfed poinfs in fhe chap- 
fer before, fhere are also several design insfrucfions concerning fhe 
user-friendly design of facefed navigafions. As Flearsf poinfed ouf, 
a compromise has fo be found befween an elaborafed and well¬ 
working funcfionalify and a clear and comprehensible design of if 
(HEARST2006) and (Hearsf). As a maffer of facf, facefed naviga¬ 
fions fend fo be overloaded and fherefore confusing fo users. Thaf's 

^Please find the complete bibliographic reference of the study at the end of the 
text 
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why recommendations concerning visual options, the choice of 
facets, the grouping of latters and labels, such as those of (REINHARD2009) 
or (HEARST2006) and (Hearst) should be taken into account and 
analyzed regularly by users. Experience in ACCEPT underlines 
above mentioned conclusions and has detected furthermore sev¬ 
eral returning issues. It turns out that there are some 'unwritten 
standards' concerning a user-friendly and useful design for faceted 
navigation. These mistakes are elaborated in order of their frequency 
of appearance within the studies. 


Labelling 

The most important problem, which occurred in four studies (1, 
4, 5 and 6) during the interaction with faceted navigation, concerns 
undetailed or unclear labelling. As shown in 1 on the following page, 
fhe facet "authors/collaborators" makes no distinction between au¬ 
thors and contributors. During the test, users criticized this element, 
and asked for more simplicity by using i.e. only the label "author". 


Number of displayed facets 

The number of displayed facets as well as displayed results are 
regularly discussed issues, which include questions about design 
and performance. In four studies in the context of ACCEPT, this 
topic was indeed considered to be a problem (1, 3,4 and 5). In this 
case, users didn't see the possibility to enlarge the number of results, 
which may be an indicator for the lack of a comprehensible design 2 
on the next page. 
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Refine search 


Authcirs, Cdllaborjitars 


► Baumann, Christian Jaknb 2 

^ Rohr, Julius Bernhard vor 2 

► Baumeister, Reinhard l 

* CaHowitz^ Harnss Carl von 1 

► Cdoke, William Fotherigiill 1 

Show L4 mare 

Figure 1 


^ Year of publication 

vor1950 (13982)» 
1950-1960 (4266)» 
1960-1970 (9458)» 
1970-1980 (22122)» 
1980-1990 (36651)» 

Display more... 


Figure 2 
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Breadcrumbs (chosen filters) 

Once, a facet has been selected by a user, generally a breadcrumb 
appears, which indicates to the user, which facets he / she has cho¬ 
sen 3 on the following page. Results of three studies have shown 
that these breadcrumbs are often not looked on, because they are 
too small or too similar to the general faceted navigation design (4 
on page 93; 1,4, 5). 

It would be preferable to display them in a different visual dis¬ 
play and slightly adapt the design 4 on page 93. 


Restart 

In two studies, the following issue was a problem: Once clicked 
on a facet, it remained active, even after a new search (1 and 5). In 
worst-case scenarios, users didn't find any results because of the still 
activated facet 5 on page 93. 


Font Size 

The font size should be mentioned as an issue that deals with 
accessibility. This problem was raised in two studies (4 and 7). 
Consequently, users are not able to read the content of a website 
properly and won't be satisfied. 


Year range 

The last issue mentioned concerns the display of the "year". One 
of our study revealed different design topics concerning the "year" 
facet, to which all designers should pay attention (5). As shown 
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Figure 3 
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spr«ch«it 


► DtJtseS 5 

^ Hcbraisch SB 


□ruckarte 


► &Dsel 4 

► Sljrich 1 


Ctrucker / Verlage 


^ P«tri^ Adam (Ofruin, &a&e:l) 4 
► Frostihauer (Offijirir Zurich} I 


Figure 4 


Search in manuscript descriptions 

$»«rch wnni lAu*jflmod 

^I 

S*«fCh n- Full taxt 

» Sort saarch 

results by: (tatovjnc* 

-© 



Hits found (Full taxt): 0 





Figure 5 
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in 6 and ?? on page ??, different periods of years can be chosen. 
This reveals two questions: one concerning the degree of detailing 
the display of the year, another one concerning the importance 
for the retrieval of relevant results. First of all, no year should be 
used in double. The solution in ?? on page ?? below illustrates the 
difficulties. If a user wants to find documents of 1960, he or she 
doesn't know if the documents can be found in 1950-1960 or in 1960- 
1970. The left example shows how it could be solved differently. 
Furthermore, ranges should get smaller when filtering more mto 
detail. An alternative option, which has been mentioned positively 
are chronological sliders ?? on page ??. 


Periods I 

► 1601-1700 

2 

► 1701-1800 

8 

► 1801-1900 

8 


Figure 6 


Display of faceted navigation on the right or 

left 

Another important discussion is about the position of facets, 
which means if they should be shown on the left or the right-hand 
side. Test results in the context of ACCEPT revealed opposite out¬ 
comes. In one study including eye tracking, the results showed that 
facets on the right hand side are looked at (4). As can be seen in 7 on 
the facing page below, participants (n=ll) scarmed the facets, even 
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if they were on the right hand side. Still, in another study, results 
indicated that the faceted search on the left-hand side seemed to be 
a problem and users didn't use the functionality because of its weak 
visibility (7). 



Figure 7 


4 Conclusion and final recommendations 

This paper wanted to answer two questions, about users' opin¬ 
ion of faceted navigation and which design issues have an impact 
on high user satisfaction. In order to answer the two research ques¬ 
tion, seven qualitative and quantitative usability studies have been 
conducted in the context of the project ACCEPT, a subproject of the 
Swiss project e-lib.ch. 

It may be resumed that user perceived faceted navigation pos- 
ihvely, with two exceptions for first hme use. In this case, users 
stated that the functionality permits a more efficient search and 
guides them to the item of interest, by sometimes finding even more 
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relevant hits. Furthermore, they underline the simple design and the 
rapidity of the service. These results underline previous findings. 

As for the second research question, seven returning design 
issues were detected and described in order of their frequency of 
appearance. 

1. The studies showed that the most often cited issue were un¬ 
clear facet labels. Useful and clear content is as important as 
a good system performance. It must also be assumed that 
users already have an idea of whaf fhey are looking for, a 
special term or a specific document, and if fhe labels diverge 
too much from this idea, they get confused. This imderlies 
fhe imporfance of implying users info fhe labeling process by 
conducting a priori card sorting tests (Courage and Baxter); 

2. The decision about where to position the facet navigation, ei¬ 
ther on the left or the right hand side of a webpage, should 
go along with the entire design of the website. In any case, 
the users' eyes should be guided to the position of the facets. 
These findings don't go along with conventions, which say 
that users expect the navigation menu on the left-hand side 
(NIELSEN1999) and the real application in the field of e-commerce 
Still, taking into accormt other analysis (Kalbach and Bosenick), 

it can be summarized that the position does not seem to play 
such an important role, but that it is important that the web¬ 
site's design guides the user's eye to the direction of the facets; 

3. Design questions about the number of displayed facets and 
the breadcrumbs have to be answered according to end user's 
needs. Too many facets may not be a problem, if design solu¬ 
tions, which permit to open or close different facets, are em¬ 
ployed. A so called "accordion" may be a possibility to hide 

/ /webusability.co.uk. 
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or display more filters. Furthermore, result numbers must be 
enlargeable by implementing a "Display more" option beyond 
every facet. One rule is that users should not have to scroll, but 
instead see all facets at one glimpse (HEARST2006; Lemieux); 

4. Concerning breadcrumbs, a clear separation of the chosen 
facets may be a satisfying solution. Hearst even proposes that 
the breadcrumbs should be in a separate visual component of 
the webpage (2006); 

5. As for the year range, it is important to show every year only 
once. In any case, the choice has to correspond and be based 
on end users' opinions and needs. A good solution may be 
sliders; 

6. A purely performance oriented issue concerns a restart after 
a new search. As users can not have an impact on this func¬ 
tionality, it is of high importance that it works well. In the 
contrary case, it prevents them of getting appropriate results 
in an effective way. It leads furthermore to confusion or anger, 
because users may think that they and their research compe¬ 
tences may be the problem. All filters should therefore be reset 
when starting a new search; 

7. A last issue, the font size, concerns accessibility. A digital 
library should be accessible for all users, even those with hand¬ 
icaps of view. The font size should at least be 12ptx on digital 
resources. 

To finalize, as Hearst said already in 2008 «the time has arrived 
to find innovative but understandable ways to extend the faceted 
model, while at the same time retaining its essential usability. Dif¬ 
ferent designers are experimenting with this but no clear good idea 
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has emerged yet». This means nothing else that faceted naviga¬ 
tion should be used in every case. But still, this implies as well 
that different solutions are asked for different contexts and different 
users need different services. That's why, a focus on the usability of 
faceted navigation should be given in every case in order to satisfy 
the target user group and put them in the center of the development 
of the online service. 
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Abstract: The last decade transformed faceted navigation from a "nice-to-have" 
into a "must-have functionality" for all online web services that contain a search 
function. The movement has been started by commercial websites, such as online 
clothing stores, with the purpose of facilitating access to the products. Now, faceted 
search seems to be more and more well-known within the community of information 
institutions and their digital services, too, as for example the online catalogue of the 
Library of Congress or Europeana show. In this context, as well, the feature is often 
sold as an added value to access the content of their sites in a more effective way. 
Still, experience shows that the use of faceted navigation in a digital library context 
is more complex than for online clothing stores. For this reason, it is important 
to focus on the usability of such functionalities and to test it as often as possible 
during implementation and regular use, as well. Site providers have to be aware 
of one important fact: a faceted search that has not been implemented correctly 
or does not work in the way the user expects it, will create frustration and/or not 
be used at all. This implies in a worst case scenario that users don't come back 
to the site anymore, and may even spread their negative experience among the 
community. To prevent this, usability tests, either with experts or real users, should 
be conducted regularly. This can be done with common usability tests, using direct 
human interaction with a system, or with online tests, where test user are free to 
fill in the test whenever they want. In both cases, test results illuminate a system's 
weaknesses and expose dysfunctional issues, which should be improved in order to 
offer a positive experience to its users. For more than five years, the project ACCEPT, 
a subproject of a Swiss national project called e-lib.ch, analyzes the usability and 
usefulness of digital libraries, by using user oriented methods. Experience has shown 
that filters provided through faceted navigation are considered as positive and very 
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useful by end users. Nevertheless, based on different test results, several returning 
mistakes have been detected and it turns out that there are some 'unwritten standards' 
concerning e.g. position, labelling or ranking which should be respected to fulfil the 
aim of a good usability which users do expect of such web services. In this poster we 
will first give an introduction to faceted navigation, actual design issues and their 
use in digital libraries and then present testing methods, which can be easily applied 
in a digital library context. Together with a list of best practices concerning faceted 
navigation drawn out of different test experiences, the paper should give the reader 
all important information to evaluate its current faceted navigation and see where 
improvements could be made. 

Keywords: Digital libraries; Faceted navigation; Usability evaluation. 
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